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FELLER PROCESSES ON NON-LOCALLY COMPACT 

SPACES 

TOMASZ SZAREK 


Abstract. We consider Feller processes on a complete separable 
metric space X satisfying the ergodic condition of the form 


lim sup I — ^ P^{,x, O) I > 0 for some x & X, 


i=l 


where O is an arbitrary open neighbourhood of some point z £ X 
and P is a transition function. It is shown that e-chains which 
satisfy the above condition admit an invariant probability measure. 
Some results on stability of such processes are presented as well. 


1. Introduction 

The theory of Feller processes is still being developed (Eminiiia 
IT71 [THl 1211123 1211)5 although these processes have been the subject 
of several papers over 30 years ago (see |H1131131221123123123 )• in 
most of the literature the state space is assumed compact or at least 
locally compact, so that existence of an invariant measure is almost 
immediate. In the non-locally compact case this may be proved, in 
turn, if a strong form of Harris reccurence on some compact set holds 
(see |21I)- However this condition is rather very hard to verify. It is 
easier to obtain ergodicity on some open sets which, unfortunately, are 
not precompact. Similar difficulties occur when we would like to state 
the Doeblin condition (see 1211 )• 

It seems that the non-locally compact case has not yet been com¬ 
pletely analyzed. In this note we give a contribution to this. The work 
was motivated by the need to investigate the limit behaviour of discrete 
Markov chains generated by iterated function systems (1313113123123) 
and stochastic differential equations on Hilbert spaces (see |3)- The 
utility of our method in proving the existence of an invariant measure 
for stochastic partial differential equations with an impulsive noise will 
be shown in ng. 
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Let (X, p) be a complete and separable metric space and let $ = 
be a discrete-time Markov chain on X. By B{X) we denote 
the space of all Borel sets. Let P{x, A) be a transition fnnction dehned 
for X & X and A G B{X). Feller’s property means that the fnnction 
X ^ P{x, U) is lower semicontinnons for all open sets U. Alternatively 
we can say that 

C{X)3 f{-)^Pf{-)= [ f{y)P{;dy)eC{X), 

Jx 

where C{X) denotes the space of all bonnded continnons functions on 

X. 

We are interested in the existence of an invariant probability measnre 
for A measnre p is called invariant if 

p{A) = pP{A) = / P{x, A)p{dx) 

Jx 

for A G i3(X). 

Let p be an arbitrary Borel measnre. We dehne the support of the 
measure p by setting 

snpp /i = {x G X : p{B{x, e)) > 0 for every e > 0}. 

In order to establish the existence of an invariant measnre and sta¬ 
bility we introdnce the following condition: 


{S) There exists z E X snch that for every open set O containing z 


( 1 . 1 ) 


lim snp 

n^oo 





> 0 


for some x E X. 


2. Existence of invariant measures 

Proposition 2.1. Let P: X x B{X) —>■ [0,1] be a transition function 
for a discrete-time Markov chain $ and assume that condition {8) 
holds for some z E X. If {P"’f: n G N} zs equicontinuous in z for every 
Lipschitz continuous function f, then $ admits an invariant probability 
measure. 

Proof. To hnish the proof it suffices to show that for every e: > 0 there 
exists a compact set X C X snch that 

(2.1) lim infP"(^,X^) > 1 

n—»-oo 

where K'^ = {x G X : infp{x,y) < e}. This, in conjunction with 
Theorem 2.2 in [7], tells us that the measures {P'^{z, ■) : n E N} are 
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tight. Therefore the Cesaro averages are weakly precompact by the 
Prokhorov theorem (see [7j). Note that any weak limit of the Cesaro 
averages is invariant. 

Assnme, contrary to our claim, that (2.1) does not hold for some 
e > 0. By Ulam’s lemma (see [2]) there exist a sequence of compact 
sets and a sequence of integers {qi)i>i satisfying 

P^^{z,Ki)>e 

and 

(2.2) min{p(a;, y) : x e Ki, y G Kj} > e/3 for j G N, i ^ j. 

We hrst show that for every open set O containing z and j G N there 
exist y E O and i > j such that 

P«{y,Kf'^)<E/2. 

On the contrary, suppose that there exist an open set O' containing z 
and Zq G N such that 

(2.3) inf{P‘?“(z/, Kf^) -.ye O', z > Zq} > e/2. 

Let X G X be such that condition (1.1) holds with O' in place of O. 
Let a > 0 be such that 

lim sup P*(x, O')^ > a. 

By (2.2), (2.3) and the Chapman-Kolmogorov equation we obtain 
I " . { ^ \ 

lim sup — Pf > (X - io)ae/2 

n^oo ^ \ . . / 

i=l \ j=io / 

for every X > zq, which is impossible. 

We will now dehne by induction a sequence of Lipschitz continuous 
functions {fn)n>i , a sequence of points {yn)n>i, yn ^ z as n —>■ oo, 
and three increasing sequences of integers (z„)n>i, {kn)n>i, {'m'n)n>i, 
in+i > kn > in for n eN, such that 

(2.4) = 1 and 0 < /„ < l^e/ 12 , 

in 


(2.5) 

and 

( 2 . 6 ) 



{z) - P™' 




> e/4 


pr. 


U 


■e/12 


i—hn 


< e/16 for u = z, yn, 


zz G M. 
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Let n = 1. From what has already been proved, it follows that there 
exist Hi G B{z, 1) and G N such that 

< e/2. 

Set mi = qi.^ and let ki > ii be such that 


pmi 



< e/16 


for u = z, yi- 


Let fi be an arbitrary Lipschitz continuous function satisfying 
(2.7) =1 and 0 < fi < 

Thus 

\P^^fiiz)-P^^fiiyi)\ > P^^{z,K,J-P^^{yi,Kf^) > e/2. 

If n > 2 is fixed and /i,..., fn-u Vi, ■ ■ ■, Vn-i; H, ■ ■ ■, in-u h,..., kn-i, 
mi,, mn-i are given we choose a < n~^ such that 


( 2 . 8 ) 


' n—1 


'n—1 




. i=i 


. i=i 


< e/8 


for y G B{z,a) and m G N. Similarly as in the hrst part, we may 
choose yn G B{z, a) and in > kn-i such that 

P-'-(y„,K‘!'")<e/2. 

Set mn = qi„ and let /„ be an arbitrary Lipschitz continuous function 
satisfying condition (2.4). Let kn > in he such that 

P™" I w, < ^/16 for u = z, yn- 

\ i^hn / 

From this, (2.8) and the dehnition of /„ we have 




A=\ 


. i=l 


> 


P^-fn{z)-P^-fn{yn) 


'n—1 


' n—1 




. 2=1 


. 2=1 


> e/2 — e/8 > e/4. 
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We now define / = /*• (2.2) and (2.4) / is a Lipschitz 

continuous function and ||/||oo < 1- Finally, by (2.5) and (2.6) we have 

|F"‘"/(z) - P”^"/(i/n)| > e/8 for n e N 

and since i/n —>■ z as n —>■ oo, this contradicts the assumption that 
{F”/: u G N} is equicontinuous in 2 ;. □ 

The Markov transition function F is called equicontinuous if for 
/ G Cb{X) the sequence of functions {F”/: n G N} is equicontinuous 
on compact sets. Recall that by Cb{X) we denote the space of all 
bounded continuous functions with a bounded support. 

A Markov chain which possesses an equicontinuous Markov transi¬ 
tion function will be called an e—chain. 


Remark: The concept of e-chains appears in lig[inii23iniii2H]- It 
is, of course, clear that the condition appearing in the dehnition of an 
e-chain is equivalent to equicontinuity of {F”/ : n G N}, / G Cb{X), 
in every point xeX. 


In Proposition 2.1 we assumed that equicontinuity holds for all Lip¬ 
schitz continuous functions. Now we introduce a condition which al¬ 
lows to restrict to the case of all Lipschitz continuous functions with a 
bounded support. 


A continuous function R: X —> [0, 00 ) is called a Lyapunov func¬ 
tion if 


lim V{x) =00 

p{x,xq)—^oo 

for some Xq G X. 


Theorem 2.2. Let $ be an e-chain such that condition {S) holds and 
let F: X X B{X) [0,1] be its transition function. If there exist a 
Lyapunov function R: X —>• [0, cx)) and \ < 1, b < 00 , R < 00 , Xq E X 
such that 


(2.9) FR(a;) < XV{x) blB(xo,R){.x) for x eX, 

then $ admits at least one invariant probability measure. 

Proof. Observe that (2.9) implies that $ is bounded in probability, 
i. e. for a: G X and £ > 0 there exists a bounded Borel set (7 C X 
such that F"'(x, (7) > 1 — e for u G N (see |IH|)- H we assume, contrary 
to our claim, that $ does not admit an invariant probability measure, 
the same conclusion as in the proof of Proposition 2.1 can be drawn 
for some Lipschitz continuous function with a bounded support. □ 
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As an illustration of the power of Proposition 2.1, we have the fol¬ 
lowing example: 

Example: (Jump process) We consider a jump process connected 
with an iterated function system. Similar process on M” was considered 
in [2n]- Let Prob) be a probability space and let (r„)„>o be a 

sequence of random variables —>■ R_|_ with tq = 0 and such 

that Ar„ = Ty — r„_i, n > 1, are independent and have the same 
density ye"'*'*. Let {S{t))t>o be a continuous semigroup on X. We 
have also given a sequence of continuous transformations Wi : X ^ X, 

i = 1,... ,N, and a probabilistic vector ... ,pn{x)), Pi{x) > 0, 

= 1 for X G X. The pair (wi,... ,wn',Pi, ■ ■ ■ ,Pn) is called 
an iterated function system. 

Now we dehne the X-valued Markov chain $ = (‘hn)n>i in the fol¬ 
lowing way. We choose x E X and let .^i = S'(ri)(x). We randomly 
select from the set {1,... ,N} an integer A and the probability that 

ii = k is equal to Pki^i). Set $1 = 

Let $ 1 ,..., n > 2, be given. Assuming that Ar„ = Tn— 

Tn-i is independent upon $ 1 ,..., we dehne = 5'(Ar„)($n_i). 

Further, we randomly choose in from the set {1,..., A} in such a way 
that the probability of the event {in = k} is equal to Pk{^n)- Finally, 
we dehne 

We will assume that there exists r G (0,1) such that 

N 

(2.10) ^ Pi{x)p{wi{x),Wi{y)) < rp{x, y) for x,y E X. 

i=l 

Moreover, there exist a > 0 such that 

N 

(2.11) E \Piix)-Pi{y)\ < ap{x,y) ioi x,y E X 

i=l 

and A > 0 such that 

(2.12) p{S{t){x), S{t){y)) < e'^^p{x,y) for x, y G A and t > 0. 

We will assume that a semigroup {S(t))t>o admits a global attractor. 
Recall that a compact set /C C A is called a global attractor if it is 
invariant and attracting for i.e. S(t)]C = fC for every f > 0 

and for every bounded ball B and open set U, )C G U, there exists 
f* > 0 such that S{t)B G U for t > t*. 

Proposition 2.3. Assume that conditions (2.10)-(2.12) hold and 

(2.13) r + K/7<l. 
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If {S{t))t>o has a global attractor, then $ admits an invariant proba¬ 
bility measure. 

Proof. It is easily seen that $ is a Markov chain. Analysis similar to 
that in na (see also Ellin]) shows that its transition function must 
be of the form 

N poo 

(2.14) P{x,A) = '^ 'ye~'^^pi{S{t){x))lAiwi{S{t){x)))dt 

i=i -^0 

for X G X and A G B{X). Then 

^ POO 

Pfix) = '^ 'ye~'^^pi{S{t){x))f{wi{S{t){x)))dt 

i=l >^0 

for every / G C{X) and x G X. 

Let L > a'y^K — 7(1 + r))“^ and let / be a Lipschitz continuous 
function with the Lipschitz constant L. If ||/||oo < 1, then ||P/||oo < 1 
and 


\Pfix)-Pfiy)\ 


N 


^00 


7e '^^Pi{S{t){x))\f{wi{S{t){x))) - f{wi{S{t){y)))\dt 

i=i -^0 
^ poo 


i=l 


<Lr( ye ) p{x, y) + 


ye p(x, y) 


< Lp{x,y) 


for x,y ^ X. 


From this and the fact that P is linear it follows that {P""/ : n G N} 
is equicontinuous in any x G X for an arbitrary Lipschitz continuous 
function /. Let Xq G X and set V{x) = p(x, Xq) for x G X. An easy 
computation shows that 

PV (x) < ry(y — k)~^V (x) + Nh for x G X, 

where b = supj>o,i<i< 7 v Pi.'^i{S{'t){xo)), Xq) < 00 , by the fact that {S{t))t>o 
has a global attractor. Set Aq = ry(y — k)”^. By (2.13) we have Aq < 1. 
Let A G (Ao,l)- Since lA is a Lyapunov function, there exists P > 0 
such that condition (2.9) holds with b = Nb. Hence <h is bounded in 
probability (see Elj)- Fix x G X and let (7 C X be a bounded Borel 
set such that P"'(x, C) > 1/2. Let /C C X be an attractor for {S(t))t>o 
and let K = lj^i'^*(^)- Since Wi, i = 1,... ,N, are continuous, the 
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set C X is compact. Further, from (2.14) and the fact that /C was 
a global attractor, it follows that for every open set U, K C U, there 
exists a positive constant (3 such that 


Piy, U)>p for ye C. 


This and the Chapman-Kolmogorov equation give 


lim inf 

n—>oo 



Y,p‘(^,o) 


>P/2. 


Since K is compact, we see that there exists z e K such that condition 

(1.1) holds for every open neighbourhood U of ; 2 . Thus <F has an 
invariant measure by Proposition 2.1. □ 


3. Stability results 


Theorem 3.1. Let $ he an e-chain. Let P: X x B{X) —>■ [0,1] be its 
transition function and assume that there exists z e X such that for 
every open set O containing z 

(3.1) lim inf P’^(a:, O) > 0 forxeX. 

n^oo 

Let _ 

OO 

Z = \^ supp PP'{z, •). 

n=l 

If there exist a Lyapunov function V: X ^ [0, oo) and X < 1, b < oo, 
R < OO, xq e X such that (2.9) holds, then $ admits a unique invariant 
probability measure /i* supported on Z. Moreover 

7— W 

jjiP —/i* as n ^ OO 

for every probability measure /i such that supp p, C Z. 


Proof. Since (3.1) implies (1.1), from Theorem 2.2 it follows that $ has 
an invariant probability measure, say p*. It may be obtained (see [71 
ED ) as any weak limit of the Cesaro averages of {P^{z, •))n>i- Therefore 
we may assume that supp p.* C Z. 

Let us denote by A{xi,X 2 ; /; s) for xi, X 2 E X, f E Cb{X), e > 0 the 
set of all a E (0,1] such that there exist probability measures pi,p 2 
and an integer m satisfying 

(3.2) P'^ixi,-) > api{-) fori = 1,2, 

and 


(3.3) 


- / S(y)iiX’^(dy) 


'X 


lx 


< e 


for n E N. 
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We claim that sup A(a:i, X 2 ;/; e) = 1 for xi,X 2 E Z, f E Cb{X) and 
e > 0. Fix Xi,X 2 E Z, f E Cb{X) and £ > 0. By the Chapman- 
Kolmogorov equation we easily obtain that 

lim inf P^{x, Oj) >0 for x G X, 

n^oo 

where Oi is an arbitrary open set containing Xi, i = 1,2. Now from the 
proof of Proposition 2.1 it follows that the families •): n E N}, 

z = 1,2, are weakly precompact (see also Theorem 2.2 in [2j). Let 
cr > 0 be such that 


(3.4) \P'^f{z) — P"/(z/)| <e loT y E B{z,a) and n eN. 

By (3.1) there exist m eN and d > 0 such that 


Dehne 

(3.5) 


P^{xi, B{z, a)) > a for z = 1, 2. 


P^{xi,B{z,a) n •) 
P™(xi,P(z,cr)) 


for z = 1 , 2 , 


and observe that condition (3.2) is satished with /ij in place of /Zj and 
a in place of a. Moreover, from (3.4) it follows that (3.3) holds with fii 
in place of /Zj. Hence A{xi,X 2 ; f',e) 7 ^ 0. Set cto = sup A(xi, X 2 ;/; e). 
Suppose, contrary to our claim, that ao < 1. Let {an)n>i be such that 
Tn —^ To as zz —> cx) and G A(xi, X 2 ; /; e) for n G N. Let /z”, z = 1, 2, 
and iTin satisfy (3.2) with in place of a. Since {P^{xi, •): n E N}, 
z = 1,2, are tight, {P™'"(xj,-) — On/z”: n E N}, z = 1,2, are weakly 
precompact. Therefore, without loss of generality, we may assume that 
(P”*"(xj,-) — a„/z")„>i, z = 1,2, converge to some measures /zi, /Z 2 , 
respectively. Choose z/i G supp/zi and z /2 £ supp/z 2 . From (3.1) it 
follows that there exist m G M and 7 > 0 such that 


P”'(z/i,P(z,cr)) > 7 for z = 1,2. 


By Feller’s property, there is r > 0 such that 

P^{y, B{z, a)) > 7/2 for y E P(z/i, r), z = 1, 2. 


Set 

So = min{/zi(P(z/i,r)),/Z2(P(z/2,r))} 

and observe that sq > 0. By the Alexandrov theorem (see |2j) we may 
choose k eN such that 


P™'=(xi,P(z/i,r)) - akfii{B{yi,r)) > Sq/2 for z = 1 , 2 . 
Let k eN he such that 


( 3 . 6 ) 


fifc + SQ'f/4 > tto. 
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Then by the Chapman-Kolmogorov equation (see also (3.5)) we obtain 
that there exist probability measures jli with supp/ij C B{z,a), i = 
1 ,2, such that 

pW(a;^,.) - > 5o7/i,/4. 

Set 

= {oik + So7/4)"^(afc/ifP™ + So'^fii/A) for i = 1, 2. 

Since supp C B{z,a) for i = 1,2, from (3.4) it follows that p.j, 
i = 1, 2, satisfy (3.3). Finally, observe that Hi, i = 1,2, satisfy condition 
(3.2) with rrik+rn in place of m and a = a^+soy/d. Hence cifc+soy/d G 
A{xi,X 2 ; f',e), which contradicts the dehnition of ao, by (3.6). 

We have proved that 

lim f f{y)^iiP^{dy) - [ f {y){dy) = 0 
Jx Jx 

for all point measures supported on Z and for every / G Cfe(X). 

Since linear combinations of point measures are dense in the space of 
all measures equipped with the weak topology, the above convergence 
holds for all probability measures supported on Z and for every 

/ G Cfe(X). Since # is bounded in probability, the above convergence 
is also satisfied for every / G C{X). From this it follows that /i* is a 
unique invariant measure supported on Z and 

r->r7 w 

^ as n ^ cx) 

for every probability measure y such that supp y G Z, which hnishes 
the proof. □ 

A point a; G X is called reachable if for every open set O containing 

X 

OO 

P^{y, O) > 0 for every y G X. 

n=\ 

The chain # is called open set irreducible if every point is reachable. 

As a consequence of Theorem 3.1 and the above definition we obtain 
the following theorem: 

Theorem 3.2. Let # he an open set irredueihle e-chain. Let P: X x 
B{X) —[0,1] be its transition function and assume that there exists 
z G X such that for every open set O containing z condition (3.1) 
holds. If there exist a Lyapunov function V: X ^ [0, cxd) and A < 1, 
b < OO, R < OO, xq G X such that (2.9) holds, then # admits a unique 
invariant probability measure y^. Moreover 

yP^ ^ y. 


as n 


OO 
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for every probability measure ja. 
Proof. It suffices to note that 


OO 


IJ suppP"(2;, ■) = X. 


n=l 


□ 


Theorem 3.3. Let $ be an e-chain. Let P: X x B{X) [0,1] be its 
transition function and assume that there exists z & X such that for 
every open set O containing z there exists a > 0 satisfying 


(3.7) 


lim inf P^{x, O) > a for x E X. 


If there exist a Lyapunov function I/: X —>• [0, cxo) and X < 1, b < oo, 
R < OO, Xq E X such that (2.9) holds, then $ admits a unigue invariant 
probability measure Moreover 



(3.8) 


as n —>■ OO 


for every probability measure pt. 

Proof. The existence of an invariant measure /i* follows from Theorem 
2.2. Fix e: > 0, Xi,X 2 E X and / G Cb{X). By equicontinuity of 
{F”/: n E N} in z E X, we choose r > 0 such that 

(3.9) \P"'f{z) — F”/(x)| < e/4 for x E B{z,r) and n G N. 

Let a > 0 be such that (3.7) holds with O = B{z,r). Then by Fatou’s 
lemma we have 


(3.10) 


lim inf piP'^{0) > a 


for every probability measure pi. Let k E N he such that 4(1 — 
q;/2)^||/||oo < Further, from the Lasota-Yorke theorem (see Theo¬ 
rem 4.1 in [20]) and (3.10) it follows that there exist integers ni,..., 
and probability measures ..., such that supp p* C O, j = 

1,... ,k, and 



Then by the Markov property we obtain 
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for i = 1,2 and n > rii -h ... -h rik. From (3.9) we have 
^ f{y)u]P^{dy) - [ f{y)u^P^{dy) 


' X 


>x 


P-f{y)u]{dy) - / P-f{y)uUdy) 


' X 


lx 


< el2 


for j = 1,..., k. By the dehnition of k we then obtain 


\P-f{x^)-P-f{x2)\ 

= [ f{y)P^{x,,dy)- f f{y)P^X 2 ,dy) 

J X J X 

<e/2 + 2\\f\\^{l-a/2f = e. 

Since e > 0 and / G Cb{X) were arbitrary and since linear combinations 
of point measnres are dense in the space of all measnres eqnipped with 
the weak topology, we have 


lim 

n—>C50 


/ f{y)y,P^{dy) 

Jx 


[ f{y)y2P^{dy) 
Jx 


0 


for all probability measnres /ii,/i2 and for arbitrary / G Cb{X). Since 
$ is bonnded in probability, the above condition is also satished for 
every / G C{X). On the other hand, from the above condition it 
follows that /i* is a nniqne invariant measnre and 


yP 



as n —>■ oo 


for every probability measnre y, which hnishes the proof. □ 


As an immediate conseqnence of this theorem we obtain the following 
resnlt dne to L. Stettner (see isni): 

Corollary 3.4. Assume that: 

(51) for every e > 0 and every compact set K C X there exists a 
compact setWdX such that 

infa-gi^ P^{x, W) >l — e for n G N, 

(52) for every f G Cb{X) the functions (P”/ : n = 1,2,...} are 
equicontinuous on compact subsets of X, 

(53) for every open set O C X and every x E X 

P{x, O) > 0, 

(54) there exist r] > H and a compact set L G X such that for every 
compact set W G X 

P"(a:, L) > rj for some n E N. 

Then there exists a unique invariant measure /x* for $ and P"(a;, •) 
convereges weakly to /x*. 
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4. A COUNTEREXAMPLE 


In the last section we shall dehne a discrete-time Markov-Feller chain 
which satishes condition [S) bnt it has not an invariant measure. 

Let (hi, JF, Prob) be a probability space and let N = NU {cxd}. Dehne 
x;NxNxN—s>/°°by the following 

j—times 

k) = 

It is easy to see that X = x(N x N x N) is a closed subset of l°°. 
Consider the discrete-time Markov chain # = (‘hn)n>i dehned by the 
formula 

= x(Cn, r]m U) for neN, 

where (n, fjn'- ^ N and D —N are Markov chains satisfying 


Prob (Cn+l = b Vn+l = j, ^n+l = k\ (n = D, Vn = jo, U = ^o) 

Pi(io, ko) for i = 1 , j = jo + 1 , k = 1 ; 
P2{ko) for i = io, j = jo + 1 , k = ko + 1 ; 
1 - pi{io, ko) - P2{ko) for i = io + 1 , j = jo + 1 , k = ko- 


Moreover, we assume that P 2 {k) = k~'^ for k eN, pi{i, k) = 1—p 2 (^) for 
k < i\ and pi(i, k) = P 2 {k) for k > i\. Further pi(i, cx)) = ^ 2 ( 00 ) = 0. 

To show that # satishes Feller’s property hx / G C{X) and Xq G X. 
Let Xn ^ Xq as n ^ 00 . Without loss of generality we may assume 
that Xn = kn), xo = x(i, 1, CX)) and kn ^ 00 as n ^ 00 . Then 


Pf{Xn) = Pl{i, /i;„)/(x(l, j„ + 1, 1)) +p 2 (/Cn)/(x(i, jn + l,kn + 1)) 
+ (1 -Pl{i,kn) -P2{kn))f{{i + ^,jn + 1, /^n)) 

^ + = Pf{xo). 

n^oo 


Now let X = x(io,jo,/^o) be such that ko 7 ^ cx. We will show that 
there exists d > 0 such that 


(4.1) P^{x,Uo)>^ fornGN, 

where Uo = {x(i,j,/c) : i = k = 1, j E N}. Since P 2 {k) = k~‘^ for 
k eN, pi{i, k) = 1 —p 2 {k) for k < i\ and pi(i, k) = P 2 {k) for k > i!, we 
easily check that 

supE[{„| Co = *0, Vo = jo, Co = ko] < 00 . 

nSN 

Chebyshev’s inequality shows now that there exists Mo > io such that 
inf Prob (Cn < Mo | Co = A, Vo = jo, Co = ko) > 0 . 
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From this and the fact that k) = 1 — P 2 {k) for i < k\ we obtain 

7 = inf Prob (C„ < Mq!, ^„ < Mq | Co = *o, Vo = jo, Co = ko) > 0. 

nSN 

By the Markov property we have 

P^(x,Ur))>'y- min pi(i,k) for n G N, 

l<i<Mo\, l<k<Mo 

which shows that condition (4.1) holds with 

d = 7 ■ min Pi{i, k). 

l<i<Mo\, l<k<Mo 

Let 2; = (1,0,...,). Fix an open set U such that z E U. Let r > 0 
be such that B{z,r) C U. Choose k eN such that k) E B{z,r) 

for j E N. Then by the Markov property we obtain 

F”+^(a;, U) > i9p2(l) ■ • • • ■ P 2 {k) for n G N, 
which gives condition (S). 

Finally, it is obvious that # does not admit an invariant measure 
since hm„^oohn = cxd Prob-a.s. □ 
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